Research impact evaluation, a wider context: Findings from a research impact pilot

In the face of increasing pressure to demonstrate the socio-economic impact of funded research, whether it is funded directly by research councils or indirectly by governmental research block grants, institutions have to tackle the complexity of understanding, tracking, collecting, and analysing the impact of all their research activities. This paper attempts to encapsulate the wider context of research impact by delineating a broad definition of what might be classified as impact. It also suggests a number of different dimensions that can help in the development of a systematic research impact assessment framework. The paper then proceeds to indicate how boundaries and criteria around the definition of impact and these dimensions can be used to refine the impact assessment framework in order to focus on the objectives of the assessor. A pilot project, run at Brunel University, was used to test the validity of the approach and possible consequences. A tool specifically developed for the pilot, the Brunel Research Impact Device for Evaluation (BRIDE), is used for the analysis of research impact collected during the pilot. The paper reports on the findings of the analysis produced by BRIDE and confirms how a number of areas might be greatly affected by the boundaries set on definition and dimensions of research impact. The pilot project shows that useful information on impacts can be generated and it also provides a way to identify areas of work from each unit of assessment for which it would be worth developing narrative case studies. The pilot project has illustrated that it is feasible to make progress in terms of assessing impact, but that there are many difficulties to be addressed before impact assessment can be incorporated into a system of assessing the impact from the university sector as a whole. The paper concludes with an institutional perspective of the value of the approach and highlights possible applications. It also confirms the intention to expand the pilot and introduce new lines of investigation

Assessment, Evaluations and Definitions of Research Impact: A Review

This article aims to explore what is understood by the term ‘research impact’ and to provide a comprehensive assimilation of available literature and information, drawing on global experiences to understand the potential for methods and frameworks of impact assessment being implemented for UK impact assessment. We take a more focused look at the impact component of the UK Research Excellence Framework taking place in 2014 and some of the challenges to evaluating impact and the role that systems might play in the future for capturing the links between research and impact and the requirements we have for these systems.Jisc [DIINN10

Next steps in the preparation for the REF. Agreed processes, Code of Practice and compliance survey

This presentation was given by Dr Rosa Scoble, Deputy Director Planning (Research & Resources) at Brunel University, at the BRAM-NET meeting held on the 20th June 2012. The event was hosted at Brunel University. BRAM-NET (The Brunel Research Administrators & Managers Network) is a forum to share best practice and information on new initiatives between colleagues supporting research in the centre and academic areas at Brunel University

UK Research Information Shared Service (UKRISS) Final Report, July 2014

The reporting of research information is a complex and expensive activity for research organisations (ROs). There is little alignment between funders of the reporting requests made to institutions and requests made to individual researchers about their research outputs and outcomes. This inevitably results in duplication and increased costs across the sector, whilst limiting the potential sharing and reuse of the information. The UK Research Information Shared Service (UKRISS) project conducted a feasibility and scoping study for the reporting of research information at a national level based on CERIF (Common European Research Information Format), with the objective of increasing efficiency, productivity and quality across the sector. The aim was to define and prototype solutions which are compelling, easy to use, have a low entry barrier, and support innovative information sharing and benchmarking. CERIF has emerged as the preferred format for expressing research information across Europe. To date, CERIF has been piloted for specific applications, but not as a format for reporting requirements across all UK ROs. The final report presents the work carried out by the UKRISS project, including requirements gathering, modelling and prototyping, as well as recommendation for sustainability. UKRISS was divided into two phases. Phase 1, mapping the reporting landscape, ran from March 2012 to December 2012. Phase 2, exploring delivery of potential solutions, began in February 2013 and ended in December 2013

Developing a quality assurance metric: a panoptic view

This article is a post-print of the published article that may be accessed at the link below. Copyright @ 2006 Sage Publications.There are a variety of techniques that lecturers can use to get feedback on their teaching - for example, module feedback and coursework results. However, a question arises about how reliable and valid are the content that goes into these quality assurance metrics. The aim of this article is to present a new approach for collecting and analysing qualitative feedback from students that could be used as the first stage in developing more reliable quality assurance metrics. The approach, known as the multi-dimensional crystal view, is based on the belief that individuals have different views on the benefits that the embedded process in a system can have on the behaviour of the system. The results of this study indicate that in the context of evaluation and feedback methods, the multi-dimensional approach appears to provide the opportunity for developing more effective student feedback mechanisms

Funding of research in higher education : a panoptic view of the RAE

The thesis investigates the effects that the Research Assessment Exercise (RAE) has on the Higher Education sector. The alternative view presented by the thesis is that more knowledge can be created by concentrating on the different constituents of the RAE and their specific interactions with particular areas of the Higher Education sector. The RAE constituents are interpreted as drivers that influence and impact, in dissimilar fashions, on different activities of Higher Education Institutions (HEI). This micro analysis of the RAE enables the investigation to isolate the single effects of the RAE drivers therefore creating a bottom-up analysis of the overall impact of the RAE. The analysis of the impact that the drivers have on HEIs’ activities focuses on the perception that individuals within the system have of the consequences of the RAE. The focus on perceptions derives from personal observation of the lack of consensus on the consequences that different drivers have on different areas. The use of perceptions as the mean to assess the impact of the RAE enables the investigation to create a picture of the consequences of the RAE that addresses behavioural change. A multi-dimensional crystal view approach is used to accommodate both the micro analysis and the perception assessment. The multi-dimensional crystal view, a research contribution in its own right, is based on the principle that a micro analysis of a complex system can be achieved by decomposing the system into a number of dimensions. Insight is draw when the interactions between some of the dimensions are investigated. In the specific case of the RAE the dimension are: the RAE drivers, HEIs’ activities and points of observation (dimension that captures perceptions). Knowledge and insight can be acquired when the interactions between the dimensions are aggregated at successive higher levels. The supporting tool for the multidimensional crystal view approach is a matrix that facilitates the analytical process. The aggregation of the dimensions comes from combining textual statements from the points of observation (perceptions) on the effects that the drivers of the RAE have on the activities of HEIs. The highest level is a textual statement that synthesises all lower level statements.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Optimisation of classification methods to differentiate morphologically-similar pollen grains from FT-IR spectra

A growing body of research is demonstrating the potential of Fourier-Transform Infrared spectroscopy (FT-IR) to identify and differentiate morphologically similar pollen taxa. The Poaceae (grass) family is a large and complex with morphologically similar pollen grains. It is not possible to use traditional light microscopy to differentiate Poaceae species, or genus, based on pollen morphological characteristics. This research presents a study of five species from the Poaceae family found across a wide variety of different moorland vegetation communities, to test the extent to which FT-IR microspectroscopy can be used to separate and identify these species and develop statistical approaches for the analyses of these data. Moorland grasses are of particular importance to assess conservation status and baselines in fragile and scarce vegetation communities, whose vegetation composition in the past remains cryptic owing to low taxonomic resolution. Non-differentiated and second derivative spectra were combined with Principal Component Analysis (PCA) and Hierarchical Cluster Analysis (HCA) to determine whether species had different chemical compositions and would cluster. Decision trees and random forest were used to classify each species and demonstrated 100% successful classification rate. This success demonstrates that using FT-IR microspectroscopy alongside spectral pre-processing and multivariate analysis can successfully identify and separate these moorland Poaceae species and has the clear potential to improve taxonomic resolution and classification of fossil pollen records. This will improve our understanding of how past land-use practice has shaped upland communities, provide more detailed ecologically-relevant palaeoecological information, and be utilised for the restoration and conservation of upland habitats

Familial hypomagnesaemia with hypercalciuria and nephrocalcinosis (FHHNC): Compound heterozygous mutation in the claudin 16 (CLDN16) gene

<p>Abstract</p> <p>Background</p> <p>Familial hypomagnesaemia with hypercalciuria and nephrocalcinosis (FHHNC) is an autosomal recessive disorder of renal calcium and magnesium wasting frequently complicated by progressive chronic renal failure in childhood or adolescence.</p> <p>Methods</p> <p>A 7 year old boy was investigated following the findings of marked renal insufficiency and nephrocalcinosis in his 18-month old sister. He too was found to have extensive nephrocalcinosis with increased fractional excretion of magnesium: 12.4% (<4%) and hypercalciuria: 5.7 mmol (< 2.5/24 hours). He had renal impairment, partial distal renal tubular acidosis and defective urinary concentrating ability. Therapy with thiazide diuretics and magnesium supplements failed to halt the progression of the disorder. Both children subsequently underwent renal transplantation. Both children's parents are unaffected and there is one unaffected sibling.</p> <p>Results</p> <p>Mutation analysis revealed 2 heterozygous mutations in the claudin 16 gene <it>(CLDN16</it>) in both affected siblings; one missense mutation in exon 4: C646T which results in an amino acid change Arg216Cys in the second extracellular loop of <it>CLDN16 </it>and loss of function of the protein and a donor splice site mutation which changes intron 4 consensus splice site from 'GT' to 'TT' resulting in decreased splice efficiency and the formation of a truncated protein with loss of 64 amino acids in the second extracellular loop.</p> <p>Conclusion</p> <p>The mutations in <it>CLDN16 </it>in this kindred affect the second extra-cellular loop of claudin 16. The clinical course and molecular findings suggest complete loss of function of the protein in the 2 affected cases and highlight the case for molecular diagnosis in individuals with FHHNC.</p

Work, Power and Performance: Analysing the 'reality' game of The Apprentice

This article addresses the relationship between the British version of the reality television programme The Apprentice and the shifting working cultures of contemporary neoliberalism. It explores how the programme enacts, through ritualized play, many skills required by the ‘flexible’ work economy: emotional commitment, entrepreneurial adaptability, a combination of team conformity and personal ambition. In particular, it highlights how newly calibrated requirements of sociality, ‘passion’, and power-as-charisma are negotiated by the programme in relation to broader emergent norms of neoliberal governmentality. However, the article simultaneously argues against overly deterministic deployments of governmentality theory, suggesting it be both supplemented by other tools (media rituals and the affective role of passion), and reoriented back towards a Foucauldian emphasis upon the instability of power. This can, it argues, both enable the programme’s appeal to be more effectively understood and help us comprehend the spaces and places where neoliberal governmentality fails, wholly or partly, to be foregrounded

Can Deliberately Incomplete Gene Sample Augmentation Improve a Phylogeny Estimate for the Advanced Moths and Butterflies (Hexapoda: Lepidoptera)?

This paper addresses the question of whether one can economically improve the robustness of a molecular phylogeny estimate by increasing gene sampling in only a subset of taxa, without having the analysis invalidated by artifacts arising from large blocks of missing data. Our case study stems from an ongoing effort to resolve poorly understood deeper relationships in the large clade Ditrysia ( > 150,000 species) of the insect order Lepidoptera (butterflies and moths). Seeking to remedy the overall weak support for deeper divergences in an initial study based on five nuclear genes (6.6 kb) in 123 exemplars, we nearly tripled the total gene sample (to 26 genes, 18.4 kb) but only in a third (41) of the taxa. The resulting partially augmented data matrix (45% intentionally missing data) consistently increased bootstrap support for groupings previously identified in the five-gene (nearly) complete matrix, while introducing no contradictory groupings of the kind that missing data have been predicted to produce. Our results add to growing evidence that data sets differing substantially in gene and taxon sampling can often be safely and profitably combined. The strongest overall support for nodes above the family level came from including all nucleotide changes, while partitioning sites into sets undergoing mostly nonsynonymous versus mostly synonymous change. In contrast, support for the deepest node for which any persuasive molecular evidence has yet emerged (78–85% bootstrap) was weak or nonexistent unless synonymous change was entirely excluded, a result plausibly attributed to compositional heterogeneity. This node (Gelechioidea + Apoditrysia), tentatively proposed by previous authors on the basis of four morphological synapomorphies, is the first major subset of ditrysian superfamilies to receive strong statistical support in any phylogenetic study. A “more-genes-only” data set (41 taxa×26 genes) also gave strong signal for a second deep grouping (Macrolepidoptera) that was obscured, but not strongly contradicted, in more taxon-rich analyses